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1.  Objective 


The  objective  of  this  report  is  to  describe  the  history  of  Command,  Control,  and  Communications: 
Techniques  for  the  Reliable  Assessment  of  Concept  Execution  (C3TRACE),  and  the  process  for 
developing  a  model  using  C3TRACE.  C3TRACE  provides  an  environment  for  targeted 
evaluation  of  the  effects  of  different  configurations  of  Soldiers  and  infonnation  technology  on 
performance,  that  is,  both  Soldier  perfonnance  and  overall  system  performance.  C3TRACE  can 
be  used  to  identify  communication  bottlenecks,  workload  peaks,  and  decision-making  vulnera¬ 
bilities  so  that  the  combined  effectiveness  of  a  proposed  configuration  can  be  assessed  and  design 
changes  in  the  organizational  structure  or  information  technology  can  be  recommended.  An  in- 
depth  report  of  our  first  application  was  published  in  Plott,  Quesada,  Kilduff,  Swoboda,  and 
Allender  (2004).  Future  enhancements  of  C3TRACE  will  also  be  discussed  as  well  as  plans  for 
future  applications. 


2.  Background 


The  earliest  U.S.  Army  Research  Laboratory  (ARL)  Human  Research  and  Engineering 
Directorate  command  and  control  (C2)  human  performance  models  (HPMs)  were  of  a  battalion 
tactical  operations  center  (TOC)  operating  under  current  doctrine  and  using  only  analog 
communications  and  information  processing  methods  (Knapp,  Johnson,  Barnette,  Wojciechowski, 
Kilduff,  Swoboda,  &  Bird,  1997).  This  HPM  established  a  baseline  for  the  efficiency  and 
effectiveness  of  the  proposed  battalion  TOC  organizational  design.  This  model  was  then 
enhanced  to  examine  the  effects  of  introducing  digital  equipment  that  the  TOC  personnel  would 
use  to  conduct  their  missions  and  communicate  among  staff  cells  (Knapp,  Johnson,  Barnette, 
Wojciechowski,  Kilduff,  Swoboda,  Bird,  &  Plott,  1997).  Ultimately,  these  models  were  modified 
once  more  to  represent  one  possible  Army  After  Next  configuration  where  all  C2  positions  were 
equipped  with  fully  integrated  C2  systems.  All  restrictions  imposed  by  the  limitations  of  systems 
in  use  or  development  at  that  time  were  removed  (Knapp  et  ah,  1998).  These  efforts  were 
eventually  brought  together  in  a  Computer  Modeling  of  Human  Operator  System  Tasks 
(CoHOST)  project  (Middlebrooks  et  al.,  1999).  The  CoHOST  modeling  methodology  was  built 
and  exercised  to  perform  an  analysis  for  comparing  different  personnel  and  equipment 
configurations  for  operations  in  today’s  and  tomorrow’s  Anny.  CoHOST  uses  a  variety  of 
performance  measures  to  determine  effects  on  decision  making. 

Recently,  ARL  developed  an  HPM  for  evaluating  variations  of  a  concept  organization 
representing  the  manner  in  which  the  U.S.  Army  would  conduct  its  field  artillery  missions 
(Wojciechowski,  Knapp,  Archer,  Wojcik,  &  Dittman,  2000).  The  conceptual  organization 
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consisted  of  a  Fires  and  Effects  Coordination  Cell  (FECC)  and  a  field  artillery  (FA)  TOC.  This 
organizational  concept  was  developed  by  the  U.S.  Army  Depth  and  Simultaneous  Attack 
Battlelab  at  Fort  Sill,  Oklahoma,  in  order  to  move  toward  effects-based  fire  decisions,  centralized 
fire  resources,  and  opportunities  to  better  accomplish  the  commander’s  intent.  ARL  and  Micro 
Analysis  and  Design  designed  an  HPM  of  an  FECC  and  an  FA  TOC  to  analyze  human 
performance  within  those  organizational  concepts.  Individuals  perfonning  different  tasks  and 
functions  on  a  prototype  C2  system  in  co-located  and  distributed  environments  were  modeled. 
This  provided  an  economical  means  to  examine  efficiency  and  effectiveness  for  the  alternate 
organizational  concepts.  The  FECC  and  FA  TOC  models  together  provided  the  basis  for  the 
development  of  “sensor-to-shooter”  task  flow  logic.  This  logic  was  then  incorporated  in  the 
FECC  and  FA  TOC  hybrid  sensor-to-shooter  model,  also  called  Perfonnance  of  the  Virtual 
Soldier  (PERVISO),  to  create  a  more  extensive  analysis  capability  for  conceptual  brigade-level 
fires  and  effects  FA  organizational  designs  (Wojciechowski,  2001). 

Of  particular  interest  in  the  analysis  of  the  data  output  from  the  sensor-to-shooter  HPM  was  the 
capability  to  assess  the  quality  of  decisions  made  by  the  personnel  in  the  brigade-level 
organization  (Wojciechowski  et  ah,  2000).  Decision  quality  was  assumed  to  be  a  function  of  the 
initial  infonnation  quality,  decay  rate,  and  time  since  last  update.  Initial  information  quality  was 
a  measure  of  the  assumed  initial  quality  of  each  incoming  message.  The  initial  information 
quality  can  be  degraded  to  reflect  actual  communication  quality  or  can  be  left  at  the  default  of 
100%,  meaning  that  it  is  “perfect”  information.  The  time  since  last  update  detennines  the 
information  quality,  based  on  the  volatility  and  frequency  of  change  of  each  element  of 
information.  The  volatility  of  the  information  is  defined  as  how  sensitive  a  piece  of  information 
is  to  change.  For  example,  it  is  highly  unlikely  that  an  enemy  mobile  unit  will  remain  in  a 
constant  place;  therefore,  it  will  be  assigned  a  high  volatility  value.  The  frequency  of  change  is 
how  often  the  operator  should  refresh  his  or  her  knowledge  of  a  piece  of  information. 

Infonnation  that  is  high  frequency  and  high  volatility  will  have  a  higher  rate  of  infonnation 
quality  degradation  (decay)  than  low  frequency  and  low  volatility  infonnation.  Infonnation  was 
collected  in  processing  tasks,  shared  in  collaboration  tasks,  and  used  in  decision-making  tasks. 
Based  on  the  technique  just  described,  a  probability  that  the  decision  maker  would  have  the 
information  needed  to  make  a  good  decision  was  calculated.  The  output  from  these  models 
included  operator  utilization,  task  drops  and  intenupts1,  task  completions,  and  sensor-to-shooter 
timelines.  Together,  these  measures  provided  investigators  with  a  tool  that  was  used  to  examine 
the  process  of  battle  command. 

The  demand  for  greater  flexibility  and  an  easier  to  use  graphical  user  interface  (GUI)  of  the 
sensor-to-shooter  model  led  to  a  redesign  of  this  modeling  environment.  This  redesign  resulted 
in  the  modeling  environment  C3TRACE  that  can  be  used  to  develop  multiple  concept  models 


'interrupts  are  tasks  or  messages  that  are  temporarily  suspended  because  of  a  higher  priority  task  or  message 
competing  for  limited  resources. 
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easily  and  quickly.  C3TRACE  provides  a  point-and-click,  Windows2  standard  interface  that 
facilitates  the  model  development  process.  Its  greatest  value  lies  in  its  capability  to  analyze 
many  organizational  concepts  for  any  number  and  size  of  organizations,  staffed  by  any  number 
of  people,  perfonning  any  number  of  tasks,  and  under  various  communication  and  information 
loads. 

Another  modeling  tool,  IMPRINT  (Improved  Performance  Research  Integration  Tool)  was  also 
developed  by  ARL.  A  primary  use  of  this  tool  is  to  measure  and  predict  mental  workload.  It  is 
discussed  in  detail  in  Mitchell  (2000).  C3TRACE  is  similar  to  and  is  often  compared  to 
IMPRINT  because  it  has  a  similar  mission-function-task  decomposition,  as  well  as  the  same 
measure  of  operator  multi-channel  workload,  visual,  auditory,  cognitive,  psychomotor  (VACP) 
(McCracken  &  Aldrich,  1984).  What  distinguishes  C3TRACE  from  IMPRINT  is  the  fact  that 
messages  drive  the  model,  and  therefore,  the  workload  evaluation  is  a  function  of  the  infonnation 
load  and  the  associated  information  management  tasks  rather  than  the  broader  or  more  general 
mission  operation  tasks  typically  modeled  in  IMPRINT.  C3TRACE  tracks  the  infonnation  that 
is  carried  with  each  of  these  messages.  It  then  uses  the  current  quality  of  that  infonnation  at 
various  decision  points  to  determine  the  probability  of  making  a  good  decision,  based  on  the 
available  information. 

The  background  provided  here  is  a  short  overview  of  the  human  performance  modeling  efforts 
that  have  taken  place  within  the  ARL  modeling  program.  For  further  details  about  any  of  the 
aforementioned  modeling  efforts,  refer  to  references  provided  within  this  report. 


3.  Tool  Input  and  Description 


C3  TRACE  includes  a  user-configurable  GUI  for  easy  manipulation  of  organizations  and 
personnel,  the  functions  and  tasks  that  must  be  perfonned,  and  the  communication  events  that 
drive  the  model.  The  underlying  technology  is  a  discrete  event  simulation  engine  called  Micro 
Saint  Sharp3.  For  a  detailed  discussion  of  C3TRACE,  refer  to  the  Software  Users  ’  Manual  for 
C3TRACE  (Plott,  2003).  The  following  are  three  main  input  categories  required  to  build  a 
C3TRACE  model:  the  organization,  the  functions  and  tasks,  and  the  communication  events. 

3,1  Tool  Input 

1 .  Define  the  organization: 

The  first  step  in  building  a  C3  TRACE  model  is  defining  what  level  of  organizational  entities  and 
personnel  are  to  be  included  in  the  analysis.  In  C3TRACE,  this  is  accomplished  by  the  addition 
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Micro  Saint  Sharp  is  a  trademark  of  Micro  Analysis  and  Design. 
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of  sections  and  operators  into  a  hierarchical  tree  diagram.  If  appropriate,  the  organization  can  be 
broken  into  sections.  For  example,  an  organization  could  be  a  Mounted  Combat  System  (MCS) 
Company  Headquarters  (Co  HQ),  the  corresponding  sections  (or  vehicles  in  this  example),  and 
personnel  within  that  company.  There  is  no  set  limit  to  the  number  of  levels  in  the 
organizational  hierarchy  or  the  number  of  operators  represented.  Figure  1  shows  a  C3TRACE 
organization  with  the  necessary  operators  within  each  of  the  three  sections  or  vehicles. 


Q ’■  Personnel 

B  23  Infantry  Company  Headquarters  (1_1) 

a  23  C2V-1  (1_1_1) 

. 9  Fires  N  CO  (1_1JJ) 

|  VCNCQ  (1_1  _1_2) 

•~9  CD  OFF  (1  _1  _1_3) 

9  NBC  DVR  NCD  (1_1  _1_4) 

a  23 C2V'2  (u_2) 

. 9  VCNCO  (1_1_2_1) 

3  D/CDR  GFF  (1  _1_2_2) 

-3  DVR  ENL  (1  _1_2_3) 

3  C4/SIG  NCO  (1  _1_2_4) 
B|  FTTS-U_C2  (1  _1_3) 

. 3  SPLY  NCO  (1  _1_3_1) 

-9  1SG  NCO  (1  _1_3_2) 


Figure  1.  A  C3TRACE  organization  representing  an  MCS  Co 
HQ. 

In  addition  to  defining  the  organizational  structure  and  personnel  allocation,  the  user  can  further 
define  the  personnel  in  terms  of  their  specific  attributes  or  personnel  characteristics.  These 
attributes  include  military  training  level,  military  rank,  length  of  service,  battle  command 
experience,  and  Military  Occupational  Specialty.  An  analyst  can  also  set  various  model 
constraints  such  as  the  number  of  simultaneous  tasks  an  operator  can  perform  and  the  amount 
of  time  that  a  task  can  be  suspended  before  being  dropped  permanently. 

2.  Define  the  functions  and  tasks: 

The  second  step  needed  for  a  C3TRACE  model  is  to  decompose  functions  into  a  network  of 
tasks  to  include  sequencing,  decisions,  and  queues.  Functions  can  be  defined  and  sequenced 
in  a  flow  network  just  as  an  operator  performs  them.  All  tasks  are  represented  in  a  task-level 
diagram.  A  task-level  network  diagram  window  for  processing  a  message  is  shown  in  figure  2. 

Each  task  has  user-defined  attributes  including  priority;  situation  awareness  (SA)  level 
(perception,  comprehension,  prediction)  (Endsley,  1995);  mode  (manual,  automatic,  both); 
whether  decision  task,  collaborative  task,  or  both;  task  time  information;  operator  task 
assignment  (primary  operator,  alternate  primary  operator,  supporting  operator(s));  mental 
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workload  level  (VACP);  and  decision  task  information  element  weighting.  Information  element 
weighting  is  discussed  in  detail  under  item  3  which  follows.  Currently,  for  decision  tasks,  the 
user-defined  SA  levels  are  tabulated  as  frequency  counts  in  the  SA  output  report.  In  the  future, 
this  area  will  be  expanded  to  include  the  actual  effect  of  the  level  of  SA  on  decision  making. 


Figure  2.  Sample  C3TRACE  task  network  diagram  and  model  components. 


Decisions  (single,  multiple,  probabilistic,  communication-based  tactical,  user-defined  tactical) 
and  queues  are  included  as  appropriate  to  the  tasks.  A  single  decision  is  when  there  is  only  one 
task  following  the  decision  task  and  it  does  not  vary.  In  a  multiple  decision,  all  the  tasks 
following  the  decision  execute  simultaneously  after  execution  of  the  previous  task.  In  a 
probabilistic  decision,  a  probability  will  be  assigned  to  each  task  that  follows  the  decision. 

During  model  execution,  C3TRACE  will  determine  which  one  of  the  tasks  will  be  executed, 
based  on  its  assigned  probability  and  random  number  generator.  A  communication  event  tactical 
decision  type  means  that  a  specific  communication  event  determines  the  task  execution  order.  A 
user-defined  tactical  decision  type  means  that  an  algebraic  expression  will  determine  which  task 
will  be  executed  next. 

3.  Define  the  communication  events: 

The  third  major  category  for  a  C3TRACE  model  is  message  traffic  including  face  to  face 
(conversation  with  another  person  close  to  you);  digital  (common  relevant  operating  picture 
[CROP]  updates,  e-mail,  “whiteboard”  messages,  etc.);  voice  (radio  or  intercom);  and  written  (a 
note  passed  to  a  certain  operator).  The  communication  event  information  provides  the  scenario 
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“drivers”  for  the  analysis.  The  following  data  are  used  to  describe  each  communication  event: 
type  of  communication,  time  communication  entered  the  input  stream,  incoming  communication 
frequency,  initial  information  quality,  tasks  that  are  triggered  as  a  result  of  a  communication,  and 
communication  priority  by  communication  type.  Initial  information  quality  is  the  initial  quality 
of  the  incoming  message  and  defaults  to  100%.  It  can  be  changed  to  reflect  known  transmission 
quality  of  the  message  or  diminished  sensor  capability.  The  generated  computer  simulation 
model  works  according  to  a  basic  “input-throughput-output”  scheme.  That  is,  the  input  to  the 
model  are  communication  events,  which  form  an  information  event  stream  in  a  frequency-driven 
time  sequence.  As  these  communication  events  enter  the  model,  tasks  are  triggered  and 
performed  in  a  pattern  that  reflects  the  logic  from  the  task  branching  and  interrupt  priorities. 
Figure  3  shows  a  segment  of  a  C3TRACE  communications  list. 


Communications 


| Name 

Type 

Start  Time 

Generation  ID 

Information  Quali 

Code 

12 

382  -1 

100 

lnputType[Enlity. 

57 _ Redcon_3_ 

Voice 

42 

382_-1 

100 

lnputType[Entity. 

1 1 5 _ Continue_movem 

Voice 

127.4 

382_-1 

100 

InputTypefE  ntity. 

1 1 9 _ 3_92_lead_eleme 

Voice 

138 

382_-1 

100 

1  nputT  ype[E  ntity. 

120 _ SP_now_ 

Digital 

140 

382_-1 

100 

InputTypefE  ntity. 

1 38 _ CP_2_now_ 

Digital 

165 

382_-1 

100 

lnputType[E  ntity. 

1 48 _ CP_2_now_ 

Digital 

178 

382_-1 

100 

1  nputT  ype[E  ntity. 

195 _ Set_ATK_Griffin_ 

Voice 

226 

382_-1 

100 

InputTypefE  ntity. 

221 _ LD_now _ 

Digital 

250 

382_-1 

100 

lnputType[E  ntity. 

257 _ H  ave_linked_with 

Voice 

312 

382_-1 

100 

lnputType[Entity. 

259 _ PL_R  ice _ traces 

Digital 

317 

382_-1 

100 

InputTypeJE  ntity. 

272 _ PL_M  um _ movin 

Digital 

336 

382_-1 

100 

InputTypefE  ntity. 

284 _ BRT_will_linkup_ 

Voice 

353 

382_-1 

100 

InputTypeJE  ntity. 

340 _ 3_92_PL_Berry_ 

Digital 

462 

382_-1 

100 

1  nputT  ype[E  ntity. 

Figure  3.  C3TRACE  communications  list  (segment). 

In  C3TRACE,  the  user  can  define  the  nature  of  the  infonnation  that  each  message  carries.  This 
is  done  with  the  information  elements  shown  in  figure  4,  which  were  taken  from  the  U.S.  Army’s 
accelerated  decision-making  process  documentation  (Military  Intelligence  Officer  Advanced 
Course,  1996).  The  information  elements  are  grouped  into  six  categories:  (1)  information  about 
enemy  force  and  actions,  (2)  information  about  friendly  force  and  actions,  (3)  feasibility  of  the 
current  plan,  (4)  suitability  of  the  current  plan,  (5)  information  to  judge  acceptable  risk,  and 
(6)  information  about  the  enemy  course  of  action  (COA)  and  potential  COAs.  Likewise,  the  user 
defines  the  nature  of  the  information  required  for  each  decision  task.  Any  or  all  of  the 
information  elements  can  be  weighted  to  reflect  their  relative  importance  to  a  particular  decision. 
Based  on  importance,  the  weighting  scale  is  1  to  10  in  which  1  is  the  least  important  and  10  is 
the  most  important.  Figure  4  shows  the  information  element  screen.  The  modeler  must 
complete  an  information  element  screen  for  each  communication  event.  Therefore,  the  time 
needed  to  complete  this  set  of  input  will  depend  on  the  number  of  messages  in  a  given  scenario. 
The  degree  of  match  between  the  information  elements  of  the  messages  and  the  information 
required  by  each  decision  task  is  used  in  the  calculation  of  the  decision  algorithm  described  in  a 
later  section. 
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Name: 


Communication! 


Parameters]  Trigger  Information  Elements  | 

_  Completeness  -  Enemy 
Does  the  message  type  contain 
information  on  ENEMY ... 

[7  Who?  [7  When? 

17  What?  I-  Why? 

17  Where?  I-  How? 


Completeness  •  Friendly 
Does  the  message  type  contain 
information  on  FRIENDLY ... 

[7  Who?  |7  When? 

[7  What?  P  Why? 

17  Where?  P  How? 


Feasibility 

Does  the  message  type  contain 
information  on  the  feasibility  of  the 
resouices  required  for  the  situation  in 
terms  of... 

17  Time  P  Means 

Acceptable  Risk 

Does  the  message  type  contain  information  that 
can  be  used  to  judge  the  acceptable  risk  in  terms 
of ... 

F  Time  |7  Equipment 

I-  Soldiers  P  Position  Losses 

l-l  -L 1-. 

Does  the  message  type  contain  information  that  would 

Does  the  message  type  contain  information  that 

impact... 

would  help  account  for ... 

17  Mission  Accomplishment 

P  Enemy  Course  of  Action  1 

r  Compliance  with  Commander's  Guidance 

r  Enemy  Course  of  Action  2 

I-  Compliance  with  Commander's  Intent 

P  Enemy  Course  of  Action  3 

Figure  4.  The  C3TRACE  information  element  screen. 


In  addition  to  defining  the  organization,  functions  and  tasks,  and  communication  events,  the 
analyst  can  also  define  performance  shaping  factors  (PSFs).  The  factors  that  can  be  defined 
through  the  PSFs  include  the  personnel  characteristics  discussed  previously  in  section  3.1, 
item  1.  For  each  operator,  values  can  be  assigned  for  the  attributes  that  are  relevant  to  the 
personnel  in  a  particular  section.  These  values  will  be  used  to  build  a  logical  expression  that 
reflects  how  the  combination  of  these  attributes  will  affect  overall  task  execution  time.  A  PSF 
can  tell  you  how  an  operator  with  a  certain  set  of  attributes  will  perform  a  task  (take  a  longer 
amount  of  time,  the  same  amount  of  time,  or  less  time  than  the  mean  time).  Figure  5  shows  the 
PSF  screen. 
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Performance  Shaping  Functions  |  Default  Decision  Algorithm  |  User  Defined  Decision  Algorithm  |  Decay  Rates]  Overall  Workload  |  Notes  | 

Introduction 

Individual  operator  attributes  such  as  experience  and  rank  can  affect  task  performance.  For  example,  a  soldier  who  has  been  in  his  current  position  for  only  6 
months  might  take  5%  longer  to  perform  a  task. 


V  Enable  User  Defined  Performance  Shaping  Function 


4? 


liable  Factors 
MOS 


Aptitude 


Civilian  Education 


Length  of  Service  | 


Military  Training 


Time  in  Position 


Rank 


Age 


M-MOS 
A  •  Aptitude 
C  -  Civilian  Education 
L  -  Length  of  Service 
T  •  Military  Training 
P  -  Time  in  Position 
R  •  Rank 
B  -  Age 


< • Less  Than 
>  -  Greater  Than 
==  •  Logical  Equality 
<=  -  Less  than  or  Equal  to 
>=  -  Greater  than  or  Equal  to 
!=  •  Not  Equal 


x  -  Multiply 
/  -  Divide 
0  •  Group 
+  -  Addition 
•  -  Subtraction 
II  •  Logical  Or 


8c8t  •  Logical  And 


“User  Defined  Performance  Shaping  Algorithm 

Use  the  available  factors  above  to  define  the  algorithm  for  the  performance  shaping  function  (PSF) 


In  this  section  of  C3  TRACE,  you  can  build  expressions  that  define  how  each  attribute  effects  task  execution  time. 


1 

//M  :  MOS  — 

2 

//A  :  Aptitude 

3 

//C  :  Civilian  Education 

4 

//L  :  Length  of  Service 

5 

//T  :  Military  Training 

6 

//P  :  Time  in  Position 

7 

/ f R  :  Rank 

8 

//B  :  Age 

9 

return  O.O; 

Figure  5.  The  PSF  screen. 


3.2  Decision  Algorithm  Calculation 

A  successful  model  of  a  process  will  provide  predictive  measures  that  can  be  examined  to 
determine  whether  the  design  of  the  organization  or  of  information  flow  is  correct.  In  order  to 
establish  an  accurate  assessment  of  the  decisions  being  made,  an  “information-driven  decision¬ 
making”  architecture  was  embedded  into  C3TRACE  (Wojciechowski,  Wojcik,  Archer,  &  Dittman, 
2001).  The  basic  premise  behind  this  architecture  is  that  information  is  collected  in  processing 
tasks,  shared  in  collaborative  tasks,  and  used  in  decision-making  tasks.  This  architecture  takes  into 
account  which  operator  knows  what  elements  of  information,  how  recent  that  information  is  for 
each  operator,  and  whether  the  information  is  sufficient  to  support  the  decisions. 

The  three  components  of  the  decision  algorithm  used  in  C3TRACE  are  the  initial  information 
quality,  decay  rate,  and  time  since  the  last  update  of  that  information.  The  initial  information 
quality  defaults  to  100%  but  can  be  changed,  based  on  the  transmission  quality  of  the  message  or 
diminished  sensor  capability.  This  starting  quality  level  can  be  adjusted  as  a  function  of  decay 
rate  and  time  since  last  update  or  when  the  message  is  initially  executed  in  the  model.  As  the 
model  executes  and  messages  are  generated  and  forwarded  to  personnel  to  be  read,  the  “age”  of 
each  information  element  is  computed,  based  on  when  the  assigned  person  first  read  the  message 
and  how  much  time  elapsed  before  the  person  used  the  information  in  a  decision  task.  It  is  a  basic 
assumption  in  C3TRACE  that  the  older  the  information,  the  less  useful  it  is.  It  is  also  assumed 
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that  the  rate  of  decay  is  not  the  same  for  all  types  of  information.  Information  about  the  location 
of  the  enemy  is  likely  to  change  frequently  and  rapidly,  and  thus,  that  information  element  will 
decay  quickly.  Information  about  the  mission  objective  of  the  friendly  units  is  likely  to  remain 
stable  over  a  given  period  of  time,  however.  C3TRACE  provides  a  decay  algorithm  to  capture 
this  differential  decay. 

A  comparison  between  available  infonnation  and  the  information  required  to  make  a  decision 
occurs  whenever  a  decision  task  is  executed.  Does  the  decision  maker  have  the  right  informa¬ 
tion,  processed  directly  from  a  message  or  received  from  a  collaborator,  to  make  a  good  decision 
when  the  time  comes?  In  the  end,  the  “quality”  of  a  decision,  that  is,  the  probability  of  making  a 
good  decision,  is  based  on  whether  the  information  received  by  the  decision  maker  satisfies  the 
information  required  to  make  a  decision,  as  well  as  how  much  the  information  has  decayed  over 
time.  Until  further  data  are  gathered,  it  is  assumed  that  any  probability  over  50%  qualifies  as  a 
good  decision  and  under  50%,  a  poor  decision.  This  technique  can  help  to  identify  system  and 
organizational  inefficiencies,  bottlenecks,  or  obstacles  relevant  to  the  high  quality  and  current 
information  required  for  effective  decision  making. 

3.3  Output 

C3TRACE  produces  several  standard  reports.  The  operator  utilization  report  displays  the  total 
average  utilization  for  each  operator  (figure  6).  This  report  provides  the  capability  to  see  which 
operators  are  over-  or  under-utilized. 


Figure  6.  Operator  utilization  report. 
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The  operator  performance  report  shows  various  parameters  that  reflect  the  overall  performance 
of  the  operators  (figure  7).  This  report  lists  the  operator  name;  total  numbers  of  tasks  completed, 
dropped  and  interrupted;  total  time  busy  on  tasks;  and  overall  utilization  rate. 


B  OperatorPerformanoe  |  <1  >  x 


Operator 

%  Time  Busy 

Total  Time  Busy 

T  otal  Auto.  T  asks 

Total  Manual  Tasks 

Total  Both  Tasks 

Deputy  Command 

8.0509 

2.0754G1 

0 

2 

0 

Operations  and  F 

10  719223 

2.7G3334 

0 

3 

0 

Combat  Service ! 

N°° 

8.179KI45 

31.1303425 

0 

12 

0 

Force  Protection 

2.10863471 

0 

2 

0 

Figure  7.  Operator  performance  report. 


The  decision  data  report  includes  function  or  operator  name,  decision  task  name,  and  decision 


quality — whether  the  decision  was  good  or  bad  (figure  8).  This  report  reflects  how  well  a 
proposed  information  network  concept,  in  combination  with  a  given  personnel  structure,  fulfills 
Future  Force  requirements  for  overall  SA  in  support  of  Soldier  decision  making. 


Figure  8.  Decision  data  report. 


The  VACP  report  displays  the  operator  workload  data  (figure  9).  Each  operator  may  be  selected 
and  his  or  her  workload  is  displayed  as  a  line  graph  for  that  particular  operator.  Each  resource 
(VACP)  is  displayed  by  a  different  color  line. 

Additional  reports  available  are  the  utilization  over  time  report,  sensor-to-shooter  report,  SA 
report,  interrupted  tasks  report,  and  dropped  tasks  report.  These  supplemental  reports  provide 
additional  insight  for  interpreting  analysis  results. 
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<1  >  X 


9  VACP 


Figure  9.  VACP  report. 


3.4  First  Application 

In  support  of  the  U.S.  Army’s  premier  acquisition  program,  the  Future  Combat  System  (FCS), 
C3TRACE  is  being  used  to  represent  and  evaluate  performance  differences  between  FCS  concepts 
in  baseline  and  alternate  configurations  of  the  unit  of  action  MCS  Co  FIQ.  The  two  configurations 
were  conceptualized  to  use  the  same  information  technology  but  different  personnel  configurations 
and  vehicles.  Both  configurations  were  obtained  from  versions  of  the  FCS  Operational  and 
Organizational  Plan.  The  baseline  configuration  was  obtained  from  the  October  2002  version 
(Unit  of  Action  Maneuver  Battle  Lab  [UAMBL],  2002)  and  the  alternate  configuration  from  the 
June  2003  version  (UAMBL,  2003).  Results  of  data  from  the  comparison  of  these  two 
configurations  are  discussed  in  Plott  et  al.  (2004). 


4.  Future  Developments 


Luture  enhancements  of  the  C3TRACE  modeling  environment  include  plans  to  establish  a  more 
comprehensive  database  of  PSFs,  including  the  effects  of  self-efficacy,  multi-tasking  on  mission 
efficiency  and  effectiveness,  performing  tasks  and  functions  while  moving,  and  SA  on  decision 
making. 
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Work  is  currently  in  progress  to  develop  an  algorithm  for  self-efficacy  (confidence  in  one’s  own 
ability  to  do  well),  training  level,  and  uncertainty  as  determinants  of  decision-making  ability. 
Plans  also  include  possible  linkage  to  other  modeling  and  simulation  tools  such  as  the  One  Semi- 
Automated  Forces  test  bed,  which  is  commonly  used  in  concept  experimentation  (Bowers, 

2003),  Modeling  Architecture  for  Technology,  Research,  and  Experimentation  (Mathis,  2003), 
and  Atomic  Components  of  Thought-Rational  (Anderson  &  Lebiere,  1998).  Future  applications 
include  the  development  of  a  platoon-level  model  of  communication  flow  to  examine  the  effects 
on  operator  perfonnance.  Also,  there  are  plans  to  develop  a  model  to  detennine  the  effects  of 
sensor  communications  on  information  processing  and  decision  making  in  a  military  operations 
in  urban  terrain  environment. 


5.  Conclusions 


The  development  of  a  tool  to  represent  new  C3  concepts,  with  the  capability  to  easily  represent 
any  echelon  level,  the  people  assigned  to  that  organization,  the  tasks  and  functions  they  will 
perform,  and  a  communications  pattern  within  and  outside  the  organization,  will  allow  for  rapid 
“what-if  ’  evaluations  of  numerous  concepts  without  the  need  for  live  exercises  or  experiments. 
This  capability  will  save  time  and  money  and  will  support  the  evaluation  of  many  more  concepts 
than  could  be  accomplished  by  “human-in-the-loop”  experiments  alone. 

It  is  important  to  recognize  the  impact  this  modeling  tool  will  have  on  the  model-test-model 
paradigm.  After  the  initial  model  is  developed,  it  will  be  beneficial  to  observe  human-in-the- 
loop  experiments  (when  available)  to  validate  the  task  networks  within  the  model.  When 
experiments  are  not  available,  subject  matter  experts  (SMEs)  are  another  additional  source  for 
model  validation.  With  the  enhanced  data  obtained  from  experimentation  or  SME  input,  models 
can  be  modified  and  executed  for  more  realistic  and  valid  results. 

C3TRACE  is  positioned  to  support  analysis  of  the  Soldier-information  interface  in  U.S.  Army 
Future  Force  concepts.  It  supports  rapid  model  development  for  the  analysis  of  the  effectiveness 
of  personnel,  organizations,  and  information  system  technologies  in  the  Soldier-centric,  network- 
enabled  battle  space. 

C3  TRACE  distribution  is  controlled  by  the  ARL’s  Human  Research  and  Engineering 
Directorate.  For  more  information  about  the  tool  or  to  obtain  a  copy,  contact  Jennifer  Swoboda, 
(410)  278-5948,  jcrouch@arl.army.mil  or  Patricia  W.  Kilduff,  (410)  278-5874, 
pkilduff@arl.army.mil. 
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1  ARLHRED  AMCOM  AUN  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MI 
BLDG  5464  RM  202  J  MINNINGER 
REDSTONE  ARSENAL  AL  35898-7290 

1  ARLHRED  AMCOM  MSL  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MO  T  COOK 
BLDG  5400  RM  C242 
REDSTONE  ARS  AL  35898-7290 

1  ARL  HRED  USAADASCH  FLD  ELMT 
ATTN  AMSRD  ARL  HR  ME  A  MARES 
ATTN  ATSACD 
5800  CARTER  ROAD 
FORT  BLISS  TX  79916-3802 

1  ARLHRED  ARDEC  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MG  R  SPINE 
BUILDING  333 

PICAT1NNY  ARSENAL  NJ  07806-5000 


1  ARL  HRED  ARMC  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MH  C  BURNS 
BLDG  1467B  ROOM  336 
THIRD  AVENUE 
FT  KNOX  KY  40121 

1  ARLHRED  CECOM  FLD  ELMT 

ATTN  AMSRD  ARL  HR  ML  J  MARTIN 
MYER  CENTER  RM  2D3 1 1 
FT  MONMOUTH  NJ  07703-5630 

1  ARL  HRED  FT  BELVOIR  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MK  J  REINHART 

10125  KINGMAN  RD 

FORT  BELVOIR  VA  22060-5828 

1  ARLHRED  FT  HOOD  FLD  ELMT 

ATTN  AMSRD  ARL  HR  S  MIDDLEBROOKS 
MV  HQ  USAOTC 
91012  STATION  AVE  ROOM  111 
FT  HOOD  TX  76544-5073 

1  ARL  HRED  FT  HUACHUCA  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MY  M  BARNES 
2520  HEALY  AVE  STE  1 172  BLDG  51005 
FT  HUACHUCA  AZ  85613-7069 

1  ARL  HRED  FLW  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MZ  A  DAVISON 
320  MANSCEN  LOOP  STE  166 
FT  LEONARD  WOOD  MO  65473-8929 

1  ARLHRED  NATICK  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MQ  M  R  FLETCHER 
NATICK  SOLDIER  CTR  BLDG  3 
AMSRD  ARL  NSC  SE  E 
NATICK  MA  01760-5020 

1  ARL  HRED  SC&FG  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MS  C  MANASCO 
SIGNAL  TOWERS  RM  3  03 A 
FORT  GORDON  GA  30905-5233 

1  ARLHRED  STRICOM  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MT  C  CHEN 
12350  RESEARCH  PARKWAY 
ORLANDO  FL  32826-3276 

1  ARLHRED  TACOM  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MU  M  SINGAPORE 
6501  E  11  MILE  RD  MAIL  STOP  284 
BLDG  200A  2ND  FL  RM  2104 
WARREN  MI  48397-5000 
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ARLHRED  U SAFAS  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MF  C  HERNANDEZ 
BLDG  3040  RM  220 
FORT  SILL  OK  73503-5600 

ARLHRED  USAIC  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MW  E  REDDEN 
BLDG  4  ROOM  332 
FT  BENNING  GA  31905-5400 

ARL  HRED  USASOC  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MN  R  SPENCER 
DCSFDI  HF 

HQ  USASOC  BLDG  E2929 
FORT  BRAGG  NC  28310-5000 

ARL  HRED  FT  LEAVENWORTH  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MP 
D  UNGVARSKY 
BATTLE  CMD  BATTLE  LAB 
415  SHERMAN  AVE  UNIT  3 
FT  LEAVENWORTH  KS  66027-2326 

ARL  HRED  AMEDD  FLD  ELMT 
ATTN  AMSRD  ARL  HR  MM  V  RICE 
BLDG  4011  RM  217 
1750  GREELEY  RD 
FT  SAM  HOUSTON  TX  78234-5094 

ARL  HRED  SPO 

ATTN  AMSRD  ARL  HR  M  M  STRUB 
6359  WALKER  LAND  STE  100 
ALEXANDRIA  VA  22310 

ARL  HRED  JFCOM  FLD  ELMT 

ATTN  AMSRD  ARL  HR  MJF  D  BARNETTE 

JFCOM  JOINT  EXPERIMENTATION  J9 

JOINT  FUTURES  LAB 

115  LAKEVIEW  PKWY  STE  B 

SUFFOLK  VA  23535 

US  ARMY  SAFETY  CTR 

ATTN  CSSC  SE 

FORT  RUCKER  AL  36362 


ABERDEEN  PROVING  GROUND 
1  DIRECTOR 

US  ARMY  RSCH  LABORATORY 
ATTN  AMSRD  ARL  Cl  OK  (TECH  LIB) 
BLDG  4600 

1  US  ATEC 
RYAN  BLDG 
APG-AA 

1  DIRECTOR 

US  ARMY  RSCH  LABORATORY 

ATTN  AMSRD  ARL  Cl  OK  TP  S  FOPPIANO 

BLDG  459 

1  DIRECTOR 

US  ARMY  RSCH  LABORATORY 
ATTN  AMSRD  ARL  HR  MB  J  NAWLEY 
BLDG  459 

1  DIRECTOR 

US  ARMY  RSCH  LABORATORY 
ATTN  AMSRD  ARL  HR  M  F  PARAGALLO 
BLDG  459 

6  DIRECTOR 

US  ARMY  RSCH  LABORATORY 
ATTN  AMSRD  ARL  HR  P  KILDUFF  (3  CYS) 
J  SWOBODA  (3  CYS) 

BLDG  459 


MICRO  ANALYSIS  &  DESIGN  INC 
ATTN  BETHPLOTT 
4949  PEARL  E  CR  #300 
BOULDER  CO  80301 
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